{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Vocabulary size: 83\n",
      "Epoch 1/1 | Batch 0/78384 | train loss: 4.4210 | lr: 0.0010\n",
      "\n",
      "the 9Qrd6\n",
      "d\n",
      "-x9B;XftdwxAFtX5lfLxnzesdwAFHOoGWE9aHEzrscnYWh&C5:Uz*?$H@76MK6M8pTXedZIEUnX o`kZ&2'\n",
      "vazcU:9bq$kOLUYo49zb!p(VVTTLqI%$:e'OPfwG'V$m;TqN(z50uG3tUI%sTs796dFQW?dHb&J-SdbSFwg!H:8)!9qoLRi%?QJ(j(-*C.8p\n",
      "\n",
      "Epoch 1/1 | Batch 10/78384 | train loss: 3.4909 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 20/78384 | train loss: 3.1553 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 30/78384 | train loss: 3.1102 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 40/78384 | train loss: 3.1016 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 50/78384 | train loss: 3.0945 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 60/78384 | train loss: 3.0897 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 70/78384 | train loss: 3.0847 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 80/78384 | train loss: 3.0727 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 90/78384 | train loss: 3.0513 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 100/78384 | train loss: 3.0105 | lr: 0.0010\n",
      "\n",
      "the actfgw lnitye  .t(t nae tatyedeceye ho nrrh ckiibtoaa no, twte dfoloo Ssgna lbl-tsept Ilppsmrn ntg tunr angia_lrtlheeian , i   hoot\"iee \"tyswete,e\" rhutmi  aia s n urald ndhr tsvbe\" he;  cHemr ti veud\n",
      "\n",
      "Epoch 1/1 | Batch 110/78384 | train loss: 2.9496 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 120/78384 | train loss: 2.8943 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 130/78384 | train loss: 2.8487 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 140/78384 | train loss: 2.8044 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 150/78384 | train loss: 2.7523 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 160/78384 | train loss: 2.6941 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 170/78384 | train loss: 2.6351 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 180/78384 | train loss: 2.5887 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 190/78384 | train loss: 2.5506 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 200/78384 | train loss: 2.5166 | lr: 0.0010\n",
      "\n",
      "the (_ Yvattin won. wm Sfunvecot he.,ls sots. he ooG had iog the wheind. the. tmeat opsirp toon mhe\n",
      "\n",
      "noribn.. goms Atyinwe bn rVosed hit meren facawheke\n",
      "Coaku, moant llimpilt uss ry lacdethi_gifat dydsatd\n",
      "\n",
      "Epoch 1/1 | Batch 210/78384 | train loss: 2.4885 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 220/78384 | train loss: 2.4623 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 230/78384 | train loss: 2.4358 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 240/78384 | train loss: 2.4168 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 250/78384 | train loss: 2.3960 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 260/78384 | train loss: 2.3782 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 270/78384 | train loss: 2.3599 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 280/78384 | train loss: 2.3404 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 290/78384 | train loss: 2.3222 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 300/78384 | train loss: 2.3041 | lr: 0.0010\n",
      "\n",
      "the 4 Xll casey sorg, Shoutibat-Mavistibe sulnelld, bem, aus fe lon, \"he the an pimtongze nipe sther leod!\"\n",
      "sh poun had hot her wond,\n",
      "banyt wames sos fufr Awiit oeky sher\" Mekyithid? A\n",
      "aeowo .o nl bot ats\n",
      "\n",
      "Epoch 1/1 | Batch 310/78384 | train loss: 2.2855 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 320/78384 | train loss: 2.2680 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 330/78384 | train loss: 2.2479 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 340/78384 | train loss: 2.2341 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 350/78384 | train loss: 2.2137 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 360/78384 | train loss: 2.1958 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 370/78384 | train loss: 2.1779 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 380/78384 | train loss: 2.1606 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 390/78384 | train loss: 2.1468 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 400/78384 | train loss: 2.1306 | lr: 0.0010\n",
      "\n",
      "the fom buw hus thotcell gorraly,. Afor coul, frain's\n",
      "Benly\n",
      "whing wat at cechided cacerster wad't hed rapymrer, thith dewidh, ascervatolf, mow in wom. Sin!\n",
      "\"Sthesrell.\n",
      "\"\"Al therdrens, ther gorcasd pot tre\n",
      "\n",
      "Epoch 1/1 | Batch 410/78384 | train loss: 2.1086 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 420/78384 | train loss: 2.0944 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 430/78384 | train loss: 2.0793 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 440/78384 | train loss: 2.0656 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 450/78384 | train loss: 2.0507 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 460/78384 | train loss: 2.0363 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 470/78384 | train loss: 2.0211 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 480/78384 | train loss: 2.0091 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 490/78384 | train loss: 1.9908 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 500/78384 | train loss: 1.9791 | lr: 0.0010\n",
      "\n",
      "the tre mlitife. But dhand is wo! As in thack, as fof's\n",
      "bnosl tam trpigh wame, fill\n",
      "pererent buthorssco, nistipl ont and was and intere!. Wad to he sme mume hat the\n",
      "pring frimert-yet,\" he said the wat d t\n",
      "\n",
      "Epoch 1/1 | Batch 510/78384 | train loss: 1.9651 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 520/78384 | train loss: 1.9564 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 530/78384 | train loss: 1.9425 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 540/78384 | train loss: 1.9343 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 550/78384 | train loss: 1.9227 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 560/78384 | train loss: 1.9130 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 570/78384 | train loss: 1.9002 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 580/78384 | train loss: 1.8849 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 590/78384 | train loss: 1.8760 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 600/78384 | train loss: 1.8680 | lr: 0.0010\n",
      "\n",
      "the witthum, and chinsers- moerly in the tened your ul ant a ceist of the\n",
      "broanderly\n",
      "\n",
      "pevillling tlese as was repingow agcepw on this, shat in ervel\" he tlomn she\n",
      "wesp, having thar\n",
      "evenge and Bat iy her l\n",
      "\n",
      "Epoch 1/1 | Batch 610/78384 | train loss: 1.8554 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 620/78384 | train loss: 1.8460 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 630/78384 | train loss: 1.8353 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 640/78384 | train loss: 1.8255 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 650/78384 | train loss: 1.8135 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 660/78384 | train loss: 1.7984 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 670/78384 | train loss: 1.7857 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 680/78384 | train loss: 1.7745 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 690/78384 | train loss: 1.7588 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 700/78384 | train loss: 1.7503 | lr: 0.0010\n",
      "\n",
      "the Laper, buamed perens of the oece jowery, redrouse\n",
      "infoch deed nothimns and o\" Alkamy, and made and thouth wher, Onken a\n",
      "to, with had bume agark as were falkentt.\n",
      "\n",
      "\"I lying to onw, and could to owe at \n",
      "\n",
      "Epoch 1/1 | Batch 710/78384 | train loss: 1.7439 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 720/78384 | train loss: 1.7366 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 730/78384 | train loss: 1.7329 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 740/78384 | train loss: 1.7215 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 750/78384 | train loss: 1.7125 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 760/78384 | train loss: 1.7037 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 770/78384 | train loss: 1.6984 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 780/78384 | train loss: 1.6897 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 790/78384 | train loss: 1.6800 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 800/78384 | train loss: 1.6714 | lr: 0.0010\n",
      "\n",
      "the at he?\"\n",
      "\n",
      "\"soof him pittring aspentastin ttling\n",
      "hotherban, sthoor yo seppactidy youe of the coibly asy\"butch whin\" into\n",
      "the memsays and sofher's as in the hem it could he paeted nothey to go klonk ale \n",
      "\n",
      "Epoch 1/1 | Batch 810/78384 | train loss: 1.6665 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 820/78384 | train loss: 1.6581 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 830/78384 | train loss: 1.6429 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 840/78384 | train loss: 1.6352 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 850/78384 | train loss: 1.6345 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 860/78384 | train loss: 1.6241 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 870/78384 | train loss: 1.6094 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 880/78384 | train loss: 1.6028 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 890/78384 | train loss: 1.5972 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 900/78384 | train loss: 1.5873 | lr: 0.0010\n",
      "\n",
      "the I who\n",
      "A.k seen she said his almost cosle to sincialons mate to all a\n",
      "merend in there he dort chatthed of the shere by Dasce. \n",
      "I Gran:'s\n",
      "bliday,\" in vear of the drogrer. \"Dolly's whech look of cas parc\n",
      "\n",
      "Epoch 1/1 | Batch 910/78384 | train loss: 1.5770 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 920/78384 | train loss: 1.5672 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 930/78384 | train loss: 1.5695 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 940/78384 | train loss: 1.5610 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 950/78384 | train loss: 1.5487 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 960/78384 | train loss: 1.5419 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 970/78384 | train loss: 1.5388 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 980/78384 | train loss: 1.5277 | lr: 0.0010\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/1 | Batch 990/78384 | train loss: 1.5129 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1000/78384 | train loss: 1.5100 | lr: 0.0010\n",
      "\n",
      "the 1ate be's\n",
      "frimnoal domibery, the selal one of frear rridented thren his ut,\"\n",
      "she began\n",
      "celking cood them? \"Fell. I's gomen, logeted, take it to ge'sking, he had.! The hoirm ut hand, with which a por, \n",
      "\n",
      "Epoch 1/1 | Batch 1010/78384 | train loss: 1.5106 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1020/78384 | train loss: 1.4990 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1030/78384 | train loss: 1.4808 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1040/78384 | train loss: 1.4777 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1050/78384 | train loss: 1.4763 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1060/78384 | train loss: 1.4765 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1070/78384 | train loss: 1.4646 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1080/78384 | train loss: 1.4537 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1090/78384 | train loss: 1.4529 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1100/78384 | train loss: 1.4482 | lr: 0.0010\n",
      "\n",
      "the Ey'te to now\n",
      "rounds, \"And why; \"here?\" \n",
      "And with aE\n",
      "very\n",
      "blessibund! Sed the chosither at noteor.\n",
      "\n",
      "\"Wistch with his fork on the meatad, to gle his\n",
      "sadoriben.\n",
      "\n",
      "\"Well, it you me; shill! You horned bloon\n",
      "\n",
      "Epoch 1/1 | Batch 1110/78384 | train loss: 1.4325 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1120/78384 | train loss: 1.4245 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1130/78384 | train loss: 1.4212 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1140/78384 | train loss: 1.4160 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1150/78384 | train loss: 1.4043 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1160/78384 | train loss: 1.3949 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1170/78384 | train loss: 1.3995 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1180/78384 | train loss: 1.3966 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1190/78384 | train loss: 1.3833 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1200/78384 | train loss: 1.3741 | lr: 0.0010\n",
      "\n",
      "the ywa mays there, not nother.\"\n",
      "\n",
      "\"I think said his preideroul! A safer, and we coulctirbang\n",
      "consio, \"that choutly that's answerbe like as\n",
      "comitanould coultos,\n",
      "Klatyer.\"\n",
      "\n",
      "The most at musw in a they had ev\n",
      "\n",
      "Epoch 1/1 | Batch 1210/78384 | train loss: 1.3752 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1220/78384 | train loss: 1.3670 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1230/78384 | train loss: 1.3578 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1240/78384 | train loss: 1.3475 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1250/78384 | train loss: 1.3462 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1260/78384 | train loss: 1.3424 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1270/78384 | train loss: 1.3376 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1280/78384 | train loss: 1.3251 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1290/78384 | train loss: 1.3320 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1300/78384 | train loss: 1.3265 | lr: 0.0010\n",
      "\n",
      "the \n",
      "tupititeo hoowhert part\n",
      "in achost smibeenol to frad.\n",
      "\n",
      "\n",
      "All maped,\n",
      "and as\n",
      "imed up they mards, talk, a gatter vack of the gontane, thad ned, prysyivg the calers, that it, ner, was\n",
      "condered Levin, and f\n",
      "\n",
      "Epoch 1/1 | Batch 1310/78384 | train loss: 1.3140 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1320/78384 | train loss: 1.3046 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1330/78384 | train loss: 1.3088 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1340/78384 | train loss: 1.3057 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1350/78384 | train loss: 1.2942 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1360/78384 | train loss: 1.2895 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1370/78384 | train loss: 1.2923 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1380/78384 | train loss: 1.2905 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1390/78384 | train loss: 1.2730 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1400/78384 | train loss: 1.2640 | lr: 0.0010\n",
      "\n",
      "the micent it-a comping it usen. Stepan Arkadyevitch,\" said Levin, and he with to pligase then it seasituon of certnot\n",
      "all wend with much were their by undersa.\n",
      "\n",
      "Yere\n",
      "did was it was twises, and nove intun\n",
      "\n",
      "Epoch 1/1 | Batch 1410/78384 | train loss: 1.2731 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1420/78384 | train loss: 1.2652 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1430/78384 | train loss: 1.2477 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1440/78384 | train loss: 1.2424 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1450/78384 | train loss: 1.2449 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1460/78384 | train loss: 1.2369 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1470/78384 | train loss: 1.2313 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1480/78384 | train loss: 1.2237 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1490/78384 | train loss: 1.2294 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1500/78384 | train loss: 1.2278 | lr: 0.0010\n",
      "\n",
      "the Gaayit on all only I mactern\n",
      "till to glf more of his only out fes, one as\n",
      "prother of a parjuling lice as have abouther.\n",
      "\n",
      "\"Ah tim, us rome to sud you,\" said Grinevitch, pligiatityy, he was\n",
      "alonghy in t\n",
      "\n",
      "Epoch 1/1 | Batch 1510/78384 | train loss: 1.2133 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1520/78384 | train loss: 1.2034 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1530/78384 | train loss: 1.2072 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1540/78384 | train loss: 1.2043 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1550/78384 | train loss: 1.1975 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1560/78384 | train loss: 1.1867 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1570/78384 | train loss: 1.1884 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1580/78384 | train loss: 1.1837 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1590/78384 | train loss: 1.1736 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1600/78384 | train loss: 1.1670 | lr: 0.0010\n",
      "\n",
      "the uvatthible's off-hard; but Ghearnevs impnion, there is at onll breat in they seak\n",
      "though that a chroxuss of two, they as the comlonskys\n",
      "theregicent with. O\n",
      "lift roge himble's Pridect of the mesting, a\n",
      "\n",
      "Epoch 1/1 | Batch 1610/78384 | train loss: 1.1712 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1620/78384 | train loss: 1.1659 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1630/78384 | train loss: 1.1571 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1640/78384 | train loss: 1.1548 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1650/78384 | train loss: 1.1618 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1660/78384 | train loss: 1.1563 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1670/78384 | train loss: 1.1471 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1680/78384 | train loss: 1.1460 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1690/78384 | train loss: 1.1480 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1700/78384 | train loss: 1.1442 | lr: 0.0010\n",
      "\n",
      "the mufel,\" go on's rewreat complacented.\n",
      "\n",
      "\"Ant'lar: jlage to cunishacted his fvisites, then Levin...\n",
      "he consor another to a chile to the emorether\n",
      "trumed at\n",
      "this derition.\n",
      "\n",
      "\"I denten to stenings. Oblonsk\n",
      "\n",
      "Epoch 1/1 | Batch 1710/78384 | train loss: 1.1350 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1720/78384 | train loss: 1.1366 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1730/78384 | train loss: 1.1340 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1740/78384 | train loss: 1.1395 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1750/78384 | train loss: 1.1297 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1760/78384 | train loss: 1.1287 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1770/78384 | train loss: 1.1282 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1780/78384 | train loss: 1.1321 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1790/78384 | train loss: 1.1213 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1800/78384 | train loss: 1.1143 | lr: 0.0010\n",
      "\n",
      "the taey-waw soul to do ay iccomsia few fan chal\n",
      "still to him by her veryin, and elid the fermen firming with the first of his scine to be himself, Levin. \"Ond them he's boy were to myshat at it's to you,\n",
      "\n",
      "Epoch 1/1 | Batch 1810/78384 | train loss: 1.1219 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1820/78384 | train loss: 1.1194 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1830/78384 | train loss: 1.1046 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1840/78384 | train loss: 1.1086 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1850/78384 | train loss: 1.1069 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1860/78384 | train loss: 1.1109 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1870/78384 | train loss: 1.1003 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1880/78384 | train loss: 1.1064 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1890/78384 | train loss: 1.1041 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1900/78384 | train loss: 1.1103 | lr: 0.0010\n",
      "\n",
      "the AitPowhin! yotwe' was that, to year you come, to, let, yever gently usent, she was one wan. Ahe Stepan Arkadyevitch thoughan's caller that we chare. On take to her skopited they shear drew had bet at \n",
      "\n",
      "Epoch 1/1 | Batch 1910/78384 | train loss: 1.0942 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1920/78384 | train loss: 1.0956 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1930/78384 | train loss: 1.1032 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1940/78384 | train loss: 1.1049 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1950/78384 | train loss: 1.0976 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1960/78384 | train loss: 1.0965 | lr: 0.0010\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/1 | Batch 1970/78384 | train loss: 1.0925 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1980/78384 | train loss: 1.0956 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 1990/78384 | train loss: 1.0804 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2000/78384 | train loss: 1.0829 | lr: 0.0010\n",
      "\n",
      "the goosithas oves, but periention. A shounce has to deen went about was dowedly,\n",
      "he depakes rearing grantion off-with the more to the friendsor. The lattand, without deesing or more her, with with houso-\n",
      "\n",
      "Epoch 1/1 | Batch 2010/78384 | train loss: 1.0824 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2020/78384 | train loss: 1.0810 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2030/78384 | train loss: 1.0721 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2040/78384 | train loss: 1.0726 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2050/78384 | train loss: 1.0758 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2060/78384 | train loss: 1.0746 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2070/78384 | train loss: 1.0691 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2080/78384 | train loss: 1.0656 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2090/78384 | train loss: 1.0684 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2100/78384 | train loss: 1.0627 | lr: 0.0010\n",
      "\n",
      "the eiky!\"\n",
      "-bot a is consicaet.\n",
      "\n",
      "\"Ov? you kave to look at her's long?\"\n",
      "\n",
      "he nod sister, unding\n",
      "in Oblonsky. He naper all\n",
      "fight\n",
      "tamily had stracglen, hud been matter.\n",
      "\n",
      "\"I don't harded He. I and there was no\n",
      "\n",
      "Epoch 1/1 | Batch 2110/78384 | train loss: 1.0558 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2120/78384 | train loss: 1.0517 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2130/78384 | train loss: 1.0517 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2140/78384 | train loss: 1.0524 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2150/78384 | train loss: 1.0414 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2160/78384 | train loss: 1.0400 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2170/78384 | train loss: 1.0393 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2180/78384 | train loss: 1.0366 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2190/78384 | train loss: 1.0361 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2200/78384 | train loss: 1.0331 | lr: 0.0010\n",
      "\n",
      "the $upait at say in those seeming him as the that he was\n",
      "in the strange shimed which tals the get.\"\n",
      "\n",
      "\"I anh evenot but disthing of where enner to as it, in the world, is differene artw exprescion, quares\n",
      "\n",
      "Epoch 1/1 | Batch 2210/78384 | train loss: 1.0451 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2220/78384 | train loss: 1.0430 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2230/78384 | train loss: 1.0409 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2240/78384 | train loss: 1.0369 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2250/78384 | train loss: 1.0427 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2260/78384 | train loss: 1.0440 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2270/78384 | train loss: 1.0459 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2280/78384 | train loss: 1.0316 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2290/78384 | train loss: 1.0338 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2300/78384 | train loss: 1.0318 | lr: 0.0010\n",
      "\n",
      "the Livit you went of might liffle at the matural still and effelt chatce sainer, oven beave find brighed up to Oblonsky's offat her\n",
      "scubsice, and his of Stepan\n",
      "Arkadyevitch almed him are dore come, he wa\n",
      "\n",
      "Epoch 1/1 | Batch 2310/78384 | train loss: 1.0405 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2320/78384 | train loss: 1.0277 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2330/78384 | train loss: 1.0367 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2340/78384 | train loss: 1.0290 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2350/78384 | train loss: 1.0315 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2360/78384 | train loss: 1.0179 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2370/78384 | train loss: 1.0212 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2380/78384 | train loss: 1.0168 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2390/78384 | train loss: 1.0201 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2400/78384 | train loss: 1.0103 | lr: 0.0010\n",
      "\n",
      "the kwpueetut-datin Iway. And I dave was stald.\"\n",
      "\n",
      "He he's peferel manp at Oblonsky feeling a paintion of her mone,\" and soment to wipty.\n",
      "\n",
      "\"You know, I have\n",
      "cone, buce--I've in anow you conblove and she my\n",
      "\n",
      "Epoch 1/1 | Batch 2410/78384 | train loss: 1.0058 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2420/78384 | train loss: 1.0073 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2430/78384 | train loss: 1.0089 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2440/78384 | train loss: 0.9987 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2450/78384 | train loss: 1.0085 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2460/78384 | train loss: 1.0043 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2470/78384 | train loss: 0.9996 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2480/78384 | train loss: 0.9996 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2490/78384 | train loss: 1.0030 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2500/78384 | train loss: 0.9984 | lr: 0.0010\n",
      "\n",
      "the apwslee,\" raring Levin, and\n",
      "frush again?\n",
      "\n",
      "\"Do\n",
      "you know I love?\"\n",
      "\n",
      "\"_Pifhters your don't hoirs,\" said the by skates, and mungly in they way in the mone acread Shtcherbatskyed a leagher; _it's one aprain\n",
      "\n",
      "Epoch 1/1 | Batch 2510/78384 | train loss: 0.9951 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2520/78384 | train loss: 0.9784 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2530/78384 | train loss: 0.9827 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2540/78384 | train loss: 0.9761 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2550/78384 | train loss: 0.9713 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2560/78384 | train loss: 0.9662 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2570/78384 | train loss: 0.9698 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2580/78384 | train loss: 0.9564 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2590/78384 | train loss: 0.9571 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2600/78384 | train loss: 0.9543 | lr: 0.0010\n",
      "\n",
      "the twitettft tay! I'm nest I'm waking the had,\" steid, Levin, pmilian, giving at the grairs offy,\n",
      "hew their\n",
      "skater tone in gold heg?\"\n",
      "\n",
      "th?\n",
      "refy so, I have be down are to cumpessky there,\n",
      "swalling Oblons \n",
      "\n",
      "Epoch 1/1 | Batch 2610/78384 | train loss: 0.9536 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2620/78384 | train loss: 0.9508 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2630/78384 | train loss: 0.9542 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2640/78384 | train loss: 0.9491 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2650/78384 | train loss: 0.9445 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2660/78384 | train loss: 0.9360 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2670/78384 | train loss: 0.9346 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2680/78384 | train loss: 0.9367 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2690/78384 | train loss: 0.9314 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2700/78384 | train loss: 0.9299 | lr: 0.0010\n",
      "\n",
      "the ;z:`bk&AEXvUh\n",
      "-Rppruptthu and Aekoutened the\n",
      "country forgation.\n",
      "I munt fow:... That that the fave is though you have and I'm\n",
      "foive,\n",
      "thete skating--the\n",
      "Frenched holrited, batgising haw his cousers, was\n",
      "\n",
      "Epoch 1/1 | Batch 2710/78384 | train loss: 0.9268 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2720/78384 | train loss: 0.9330 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2730/78384 | train loss: 0.9234 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2740/78384 | train loss: 0.9185 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2750/78384 | train loss: 0.9248 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2760/78384 | train loss: 0.9313 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2770/78384 | train loss: 0.9277 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2780/78384 | train loss: 0.9148 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2790/78384 | train loss: 0.9102 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2800/78384 | train loss: 0.9112 | lr: 0.0010\n",
      "\n",
      "the u`a'wat ay? My n- blush; \"How cally you go\" she say I've been to to\n",
      "quisinien come\n",
      "answered Kitty her heads her--speakl--and anga as\n",
      "the coupor the Stepan Arkadyevitch! Levin steps a creattly as every\n",
      "\n",
      "Epoch 1/1 | Batch 2810/78384 | train loss: 0.9111 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2820/78384 | train loss: 0.8989 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2830/78384 | train loss: 0.9080 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2840/78384 | train loss: 0.8963 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2850/78384 | train loss: 0.9026 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2860/78384 | train loss: 0.9066 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2870/78384 | train loss: 0.9184 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2880/78384 | train loss: 0.9144 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2890/78384 | train loss: 0.9099 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2900/78384 | train loss: 0.9090 | lr: 0.0010\n",
      "\n",
      "the EdwttTsI, ta way, I?\" al yourstation. \"I'm be the dan fell me, and I've narl comfortond of your\n",
      "skatesslesathere tool? No difft harringly ap the contwer Levin,\n",
      "he skaters; you gover him.\n",
      "\n",
      "When grster \n",
      "\n",
      "Epoch 1/1 | Batch 2910/78384 | train loss: 0.9155 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2920/78384 | train loss: 0.9075 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2930/78384 | train loss: 0.9123 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2940/78384 | train loss: 0.9014 | lr: 0.0010\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/1 | Batch 2950/78384 | train loss: 0.9057 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2960/78384 | train loss: 0.9011 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2970/78384 | train loss: 0.9093 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2980/78384 | train loss: 0.9001 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 2990/78384 | train loss: 0.9058 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3000/78384 | train loss: 0.8931 | lr: 0.0010\n",
      "\n",
      "the whdnoh,wu-ano'wht! tald us it opensabdle binquaites. \"But ons, you excelling's for would nothing, bowing of the was a\n",
      "shallong seem, fork rotn rove teling her, and was went to Mas into pass. And face,\n",
      "\n",
      "Epoch 1/1 | Batch 3010/78384 | train loss: 0.8995 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3020/78384 | train loss: 0.8919 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3030/78384 | train loss: 0.8884 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3040/78384 | train loss: 0.8877 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3050/78384 | train loss: 0.8885 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3060/78384 | train loss: 0.8782 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3070/78384 | train loss: 0.8886 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3080/78384 | train loss: 0.8795 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3090/78384 | train loss: 0.8841 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3100/78384 | train loss: 0.8716 | lr: 0.0010\n",
      "\n",
      "the jRksAxapA/DN I1Lnnnoyeshedray----auch, obourds reculoarcessell sish after about once not even we like a\n",
      "devin speaking one for he up apfort to smoth.\n",
      "\n",
      "\"Everyth?\"\n",
      "\n",
      "\"All flvs id,\n",
      "andwhos, stifice\", he f\n",
      "\n",
      "Epoch 1/1 | Batch 3110/78384 | train loss: 0.8795 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3120/78384 | train loss: 0.8701 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3130/78384 | train loss: 0.8732 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3140/78384 | train loss: 0.8651 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3150/78384 | train loss: 0.8781 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3160/78384 | train loss: 0.8745 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3170/78384 | train loss: 0.8794 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3180/78384 | train loss: 0.8689 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3190/78384 | train loss: 0.8752 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3200/78384 | train loss: 0.8724 | lr: 0.0010\n",
      "\n",
      "the ueg, 'qyswaef\n",
      "a  wh emptin\n",
      "thoigh, had been his sander things, beched his into coming rightends that he was from to him natured her for the Tatar.\n",
      "\n",
      "Levin knew Postear her. And if as it were day!\"\n",
      "Oble\n",
      "\n",
      "Epoch 1/1 | Batch 3210/78384 | train loss: 0.8738 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3220/78384 | train loss: 0.8692 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3230/78384 | train loss: 0.8651 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3240/78384 | train loss: 0.8693 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3250/78384 | train loss: 0.8702 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3260/78384 | train loss: 0.8574 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3270/78384 | train loss: 0.8645 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3280/78384 | train loss: 0.8703 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3290/78384 | train loss: 0.8670 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3300/78384 | train loss: 0.8541 | lr: 0.0010\n",
      "\n",
      "the 7&ye;  ttkttttttssaad thauths, that \" stend unstant, and dood that we could be\n",
      "than arming man\n",
      "say harx apparents all that he knew\n",
      "expressions over, which alrord in\n",
      "the tarboaund quarrels, and Golabve\n",
      "\n",
      "Epoch 1/1 | Batch 3310/78384 | train loss: 0.8627 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3320/78384 | train loss: 0.8585 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3330/78384 | train loss: 0.8541 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3340/78384 | train loss: 0.8519 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3350/78384 | train loss: 0.8530 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3360/78384 | train loss: 0.8562 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3370/78384 | train loss: 0.8477 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3380/78384 | train loss: 0.8494 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3390/78384 | train loss: 0.8474 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3400/78384 | train loss: 0.8525 | lr: 0.0010\n",
      "\n",
      "the arks6) wahaT\n",
      "at h as wall that's \"Good. what to my forsay, your\n",
      "excellech what a cugnes, then fried it, \"you're very much\n",
      "atturl this shoudite. He\n",
      "wait Oblonsky. Flas to that turns air.\"\n",
      "\n",
      "\"But you're \n",
      "\n",
      "Epoch 1/1 | Batch 3410/78384 | train loss: 0.8551 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3420/78384 | train loss: 0.8498 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3430/78384 | train loss: 0.8429 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3440/78384 | train loss: 0.8461 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3450/78384 | train loss: 0.8439 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3460/78384 | train loss: 0.8320 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3470/78384 | train loss: 0.8362 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3480/78384 | train loss: 0.8325 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3490/78384 | train loss: 0.8364 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3500/78384 | train loss: 0.8315 | lr: 0.0010\n",
      "\n",
      "the Xuwathme whathaid has to be the moen like to to gill be loade annt,\" he said.\n",
      "And the house tore jushing the quinted in the hollowhan to marry over Gone that do of light on this wea Oblonsky's derya n\n",
      "\n",
      "Epoch 1/1 | Batch 3510/78384 | train loss: 0.8303 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3520/78384 | train loss: 0.8357 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3530/78384 | train loss: 0.8330 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3540/78384 | train loss: 0.8357 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3550/78384 | train loss: 0.8342 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3560/78384 | train loss: 0.8337 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3570/78384 | train loss: 0.8299 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3580/78384 | train loss: 0.8297 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3590/78384 | train loss: 0.8222 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3600/78384 | train loss: 0.8253 | lr: 0.0010\n",
      "\n",
      "the moemmkm? bur, krsbsds un wait wile and sort of her for to him, but at the whole soul come came on wfuldoming and easile.\"\n",
      "\n",
      "Vtrongo Levin.\n",
      "\n",
      "\"No, I don't.\" hell was and that, and afraid weathay pass.\n",
      "\n",
      "\"\n",
      "\n",
      "Epoch 1/1 | Batch 3610/78384 | train loss: 0.8267 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3620/78384 | train loss: 0.8189 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3630/78384 | train loss: 0.8174 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3640/78384 | train loss: 0.8138 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3650/78384 | train loss: 0.8162 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3660/78384 | train loss: 0.8124 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3670/78384 | train loss: 0.8122 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3680/78384 | train loss: 0.8150 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3690/78384 | train loss: 0.8201 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3700/78384 | train loss: 0.8226 | lr: 0.0010\n",
      "\n",
      "the creteghast hame throughtle, has gin be, too, and very intellible the\n",
      "words arxident. The felt to be\n",
      "from for by him peomed to be Her. \"But thought love wifh them feeling\n",
      "glpicical place that her for v\n",
      "\n",
      "Epoch 1/1 | Batch 3710/78384 | train loss: 0.8204 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3720/78384 | train loss: 0.8271 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3730/78384 | train loss: 0.8266 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3740/78384 | train loss: 0.8252 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3750/78384 | train loss: 0.8154 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3760/78384 | train loss: 0.8238 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3770/78384 | train loss: 0.8215 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3780/78384 | train loss: 0.8240 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3790/78384 | train loss: 0.8118 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3800/78384 | train loss: 0.8071 | lr: 0.0010\n",
      "\n",
      "the mtesmall, ok rounet had her towards, and apone of truid, down in the . have to say of her off? Ever suppiney and other that have to do this, gues they from the princepted overwort and he sexing. I hav\n",
      "\n",
      "Epoch 1/1 | Batch 3810/78384 | train loss: 0.8093 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3820/78384 | train loss: 0.8083 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3830/78384 | train loss: 0.8073 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3840/78384 | train loss: 0.8160 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3850/78384 | train loss: 0.8078 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3860/78384 | train loss: 0.8114 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3870/78384 | train loss: 0.8089 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3880/78384 | train loss: 0.8122 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3890/78384 | train loss: 0.7982 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3900/78384 | train loss: 0.7987 | lr: 0.0010\n",
      "\n",
      "the eJt't''bvatm, may, Imn hade be do whole each day nothing room, and her life.\"\n",
      "\n",
      "\"At't much see that\n",
      "I to don't a carred his heart invacquainty.\n",
      "\n",
      "\"What's Vrons of you are,\n",
      "and ded chis\n",
      "evening, the quee\n",
      "\n",
      "Epoch 1/1 | Batch 3910/78384 | train loss: 0.7931 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3920/78384 | train loss: 0.8038 | lr: 0.0010\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/1 | Batch 3930/78384 | train loss: 0.7914 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3940/78384 | train loss: 0.7939 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3950/78384 | train loss: 0.7876 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3960/78384 | train loss: 0.7960 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3970/78384 | train loss: 0.7924 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3980/78384 | train loss: 0.7930 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 3990/78384 | train loss: 0.7936 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4000/78384 | train loss: 0.7907 | lr: 0.0010\n",
      "\n",
      "the sak'' tactame, don's yelucan thing! She know, as\n",
      "she before the nivn, difficults in Kitty was to\n",
      "kelwine understand.\"\n",
      "\n",
      "\"Bon't one thirk you wen pigatives. At erillif char in love with her, who can't p\n",
      "\n",
      "Epoch 1/1 | Batch 4010/78384 | train loss: 0.7862 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4020/78384 | train loss: 0.7905 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4030/78384 | train loss: 0.7891 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4040/78384 | train loss: 0.7856 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4050/78384 | train loss: 0.7936 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4060/78384 | train loss: 0.7926 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4070/78384 | train loss: 0.7766 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4080/78384 | train loss: 0.7822 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4090/78384 | train loss: 0.7816 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4100/78384 | train loss: 0.7768 | lr: 0.0010\n",
      "\n",
      "the Facmauth hasks drepter! Ahd\n",
      "the spewly mehoors effering and colle.\"\n",
      "\n",
      "\"No, it... I duriblon of here to survos shough, as\n",
      "eay intailing that the sach to\n",
      "her. But the mother light, as she fond of the was\n",
      "\n",
      "Epoch 1/1 | Batch 4110/78384 | train loss: 0.7725 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4120/78384 | train loss: 0.7791 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4130/78384 | train loss: 0.7693 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4140/78384 | train loss: 0.7745 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4150/78384 | train loss: 0.7680 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4160/78384 | train loss: 0.7640 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4170/78384 | train loss: 0.7564 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4180/78384 | train loss: 0.7591 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4190/78384 | train loss: 0.7479 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4200/78384 | train loss: 0.7512 | lr: 0.0010\n",
      "\n",
      "the ta, arde?\" anIt'\n",
      "regring for fut Vronsky me...\"\n",
      "\n",
      "She deople all the obdifical\n",
      "from her eyes, on the house at\n",
      "honor everything fortuan to there soul beculity, and the thoughts are, and \"nou.\n",
      "\n",
      "She was w\n",
      "\n",
      "Epoch 1/1 | Batch 4210/78384 | train loss: 0.7450 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4220/78384 | train loss: 0.7491 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4230/78384 | train loss: 0.7508 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4240/78384 | train loss: 0.7623 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4250/78384 | train loss: 0.7482 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4260/78384 | train loss: 0.7473 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4270/78384 | train loss: 0.7484 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4280/78384 | train loss: 0.7530 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4290/78384 | train loss: 0.7550 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4300/78384 | train loss: 0.7525 | lr: 0.0010\n",
      "\n",
      "the omea wome answer\n",
      "shroun, went us to, at have I should be muctlement\n",
      "loop\n",
      "cood\n",
      "at the coad, beformed hurbed, with his weren realized lithel, and time his every girls was\n",
      "an his grining an after more in\n",
      "\n",
      "Epoch 1/1 | Batch 4310/78384 | train loss: 0.7553 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4320/78384 | train loss: 0.7510 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4330/78384 | train loss: 0.7561 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4340/78384 | train loss: 0.7611 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4350/78384 | train loss: 0.7540 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4360/78384 | train loss: 0.7469 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4370/78384 | train loss: 0.7434 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4380/78384 | train loss: 0.7477 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4390/78384 | train loss: 0.7535 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4400/78384 | train loss: 0.7400 | lr: 0.0010\n",
      "\n",
      "the apmys', myy?'merill would be for if she fances is notelvering, wa\n",
      "yen would be a liged--abuted herself, stilate Vronsky, and saytherrall men works, and Countesss offord, were talking a genter, and sai\n",
      "\n",
      "Epoch 1/1 | Batch 4410/78384 | train loss: 0.7505 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4420/78384 | train loss: 0.7480 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4430/78384 | train loss: 0.7412 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4440/78384 | train loss: 0.7360 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4450/78384 | train loss: 0.7428 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4460/78384 | train loss: 0.7491 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4470/78384 | train loss: 0.7376 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4480/78384 | train loss: 0.7342 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4490/78384 | train loss: 0.7373 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4500/78384 | train loss: 0.7380 | lr: 0.0010\n",
      "\n",
      "the U?_gurn\n",
      "had prainctly chair, downnt the conversation, what was the fece, emple-but that he thoughts would not.\n",
      "\n",
      "\"I you thought room. When e dall the future, shall to\n",
      "heal, he all\n",
      "the becordy, the conv\n",
      "\n",
      "Epoch 1/1 | Batch 4510/78384 | train loss: 0.7337 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4520/78384 | train loss: 0.7455 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4530/78384 | train loss: 0.7496 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4540/78384 | train loss: 0.7524 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4550/78384 | train loss: 0.7463 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4560/78384 | train loss: 0.7446 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4570/78384 | train loss: 0.7418 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4580/78384 | train loss: 0.7561 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4590/78384 | train loss: 0.7535 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4600/78384 | train loss: 0.7577 | lr: 0.0010\n",
      "\n",
      "the yastthifch fruquested, what I have believed to the love, counce if\n",
      "which, was his desegness.\"\n",
      "\n",
      "\"But weever not, not know we'n told see, plays still his kid befured. Hork led\n",
      "mother of a conversation w\n",
      "\n",
      "Epoch 1/1 | Batch 4610/78384 | train loss: 0.7564 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4620/78384 | train loss: 0.7616 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4630/78384 | train loss: 0.7564 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4640/78384 | train loss: 0.7487 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4650/78384 | train loss: 0.7497 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4660/78384 | train loss: 0.7652 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4670/78384 | train loss: 0.7595 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4680/78384 | train loss: 0.7548 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4690/78384 | train loss: 0.7512 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4700/78384 | train loss: 0.7610 | lr: 0.0010\n",
      "\n",
      "the ;;k \n",
      "ok ndlint Levin.\" \n",
      "Pepped ack, lispiecy sati.\n",
      "\n",
      "\"But why he's nous not dull it do is only one of Petersburg about is, he kading\n",
      "good bymat a late eme. He saw that she was seen expecting the look i\n",
      "\n",
      "Epoch 1/1 | Batch 4710/78384 | train loss: 0.7523 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4720/78384 | train loss: 0.7493 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4730/78384 | train loss: 0.7587 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4740/78384 | train loss: 0.7685 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4750/78384 | train loss: 0.7725 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4760/78384 | train loss: 0.7598 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4770/78384 | train loss: 0.7614 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4780/78384 | train loss: 0.7645 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4790/78384 | train loss: 0.7492 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4800/78384 | train loss: 0.7495 | lr: 0.0010\n",
      "\n",
      "the wad's\n",
      "how are a qualievel, sedyed herself only mustersin's good her. \"Lorred  one thin's probles at evering lighter too, married a later in his mode. At this soon whet furs he felt for him till the\n",
      "pe\n",
      "\n",
      "Epoch 1/1 | Batch 4810/78384 | train loss: 0.7483 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4820/78384 | train loss: 0.7543 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4830/78384 | train loss: 0.7444 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4840/78384 | train loss: 0.7386 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4850/78384 | train loss: 0.7466 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4860/78384 | train loss: 0.7595 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4870/78384 | train loss: 0.7481 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4880/78384 | train loss: 0.7450 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4890/78384 | train loss: 0.7485 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4900/78384 | train loss: 0.7518 | lr: 0.0010\n",
      "\n",
      "the ?'''v'vg-hthl?.. \n",
      "\"Be've forchan; and sogetting to whick. I am\n",
      "a fullef. Oblong us the promped she hugored-noticing\n",
      "himsels. He sat she was compance each dussed barrifter maters, awposing eyesprcacelo\n",
      "\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/1 | Batch 4910/78384 | train loss: 0.7464 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4920/78384 | train loss: 0.7417 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4930/78384 | train loss: 0.7482 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4940/78384 | train loss: 0.7582 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4950/78384 | train loss: 0.7466 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4960/78384 | train loss: 0.7395 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4970/78384 | train loss: 0.7450 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4980/78384 | train loss: 0.7531 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 4990/78384 | train loss: 0.7378 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5000/78384 | train loss: 0.7398 | lr: 0.0010\n",
      "\n",
      "the N?gW\n",
      "Abtran's Sameart it spined old late respond\n",
      "rman for all,\n",
      "Vronsky, and affecting down again of the teach smile.\n",
      "\n",
      "\n",
      "\n",
      "Chip--wenting the execiouno was marming some homes, and him offer neen supning,\n",
      "\n",
      "\n",
      "Epoch 1/1 | Batch 5010/78384 | train loss: 0.7402 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5020/78384 | train loss: 0.7436 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5030/78384 | train loss: 0.7373 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5040/78384 | train loss: 0.7308 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5050/78384 | train loss: 0.7299 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5060/78384 | train loss: 0.7373 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5070/78384 | train loss: 0.7284 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5080/78384 | train loss: 0.7301 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5090/78384 | train loss: 0.7418 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5100/78384 | train loss: 0.7430 | lr: 0.0010\n",
      "\n",
      "the !'7.\"'\n",
      "Wexpy agh telle--anyghey theurchang what he fails, and people while. But why have sinsky it to o go that he wiously; and look unnof the preting himself.\n",
      "\n",
      "\"I plaghe a cobtter mathoung lady be it\n",
      "\n",
      "Epoch 1/1 | Batch 5110/78384 | train loss: 0.7337 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5120/78384 | train loss: 0.7258 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5130/78384 | train loss: 0.7346 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5140/78384 | train loss: 0.7331 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5150/78384 | train loss: 0.7154 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5160/78384 | train loss: 0.7130 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5170/78384 | train loss: 0.7293 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5180/78384 | train loss: 0.7316 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5190/78384 | train loss: 0.7151 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5200/78384 | train loss: 0.7089 | lr: 0.0010\n",
      "\n",
      "the ;on've toun shme is tonsly sugning him before\n",
      "a were eving, he had been\n",
      "had\n",
      "beenone, drown you averysfor eys.\"\n",
      "\n",
      "\"Couthed stepan Arday A mugnthen. \"But why parsed\n",
      "for this he had fall\n",
      "the brinde, dinin\n",
      "\n",
      "Epoch 1/1 | Batch 5210/78384 | train loss: 0.7240 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5220/78384 | train loss: 0.7260 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5230/78384 | train loss: 0.7193 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5240/78384 | train loss: 0.7108 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5250/78384 | train loss: 0.7232 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5260/78384 | train loss: 0.7196 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5270/78384 | train loss: 0.7217 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5280/78384 | train loss: 0.7125 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5290/78384 | train loss: 0.7169 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5300/78384 | train loss: 0.7261 | lr: 0.0010\n",
      "\n",
      "the ;abon's thougs. \"But what doW?'s say moret milien to go I are heard that in the though shaugure what prost on a lave where,\" responded Stepan Arkadyevitch, with Petersburg and deteds, but suching woul\n",
      "\n",
      "Epoch 1/1 | Batch 5310/78384 | train loss: 0.7125 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5320/78384 | train loss: 0.7105 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5330/78384 | train loss: 0.7113 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5340/78384 | train loss: 0.7127 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5350/78384 | train loss: 0.7060 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5360/78384 | train loss: 0.7061 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5370/78384 | train loss: 0.7171 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5380/78384 | train loss: 0.7164 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5390/78384 | train loss: 0.7161 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5400/78384 | train loss: 0.7052 | lr: 0.0010\n",
      "\n",
      "the a@ed gooms not;\n",
      "\"\"Fugh tell so\n",
      "you;\n",
      "he heard who man jayt meed to be dailing because she\n",
      "was cont so trutffurd unhoused for him.\"\n",
      "\n",
      "\"Shes inseat:\" said the doowing is with the evening.\n",
      "\n",
      "He sat of her c\n",
      "\n",
      "Epoch 1/1 | Batch 5410/78384 | train loss: 0.7123 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5420/78384 | train loss: 0.7189 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5430/78384 | train loss: 0.7038 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5440/78384 | train loss: 0.6990 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5450/78384 | train loss: 0.7107 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5460/78384 | train loss: 0.7107 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5470/78384 | train loss: 0.7086 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5480/78384 | train loss: 0.6991 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5490/78384 | train loss: 0.7116 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5500/78384 | train loss: 0.7126 | lr: 0.0010\n",
      "\n",
      "the ;*ftwhom,\n",
      "it'r soil you go,\" said the\n",
      "all, older on's very as is arm off,\" said her heak, Anna's face with the ideas of the selfur their face. He like the better, I thing at out woman of glad to she c\n",
      "\n",
      "Epoch 1/1 | Batch 5510/78384 | train loss: 0.7101 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5520/78384 | train loss: 0.7074 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5530/78384 | train loss: 0.7051 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5540/78384 | train loss: 0.7149 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5550/78384 | train loss: 0.7058 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5560/78384 | train loss: 0.7052 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5570/78384 | train loss: 0.7092 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5580/78384 | train loss: 0.7177 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5590/78384 | train loss: 0.7112 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5600/78384 | train loss: 0.6930 | lr: 0.0010\n",
      "\n",
      "the ;what how aof beeight opf, and catter-inselftiolle ellazils and\n",
      "Darrn's comvor take, To turning lipee.\"\n",
      "\n",
      "\"How God not to. When they?... SThing, \"you've come to see tehron.\n",
      "With the countessforlel.\n",
      "\n",
      "Vr\n",
      "\n",
      "Epoch 1/1 | Batch 5610/78384 | train loss: 0.7109 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5620/78384 | train loss: 0.7059 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5630/78384 | train loss: 0.6994 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5640/78384 | train loss: 0.6906 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5650/78384 | train loss: 0.6970 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5660/78384 | train loss: 0.6988 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5670/78384 | train loss: 0.6883 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5680/78384 | train loss: 0.6915 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5690/78384 | train loss: 0.6866 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5700/78384 | train loss: 0.6880 | lr: 0.0010\n",
      "\n",
      "the ;aa; wall'y akond ale, Madraze a coming. His\n",
      "she too the your faunf betten. Yes so mifult. You known him? Shalr maw dich are nerk before from was all the wistan told her hurbeated togenger. In, tat sa\n",
      "\n",
      "Epoch 1/1 | Batch 5710/78384 | train loss: 0.6782 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5720/78384 | train loss: 0.6717 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5730/78384 | train loss: 0.6817 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5740/78384 | train loss: 0.6856 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5750/78384 | train loss: 0.6738 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5760/78384 | train loss: 0.6768 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5770/78384 | train loss: 0.6801 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5780/78384 | train loss: 0.6767 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5790/78384 | train loss: 0.6754 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5800/78384 | train loss: 0.6649 | lr: 0.0010\n",
      "\n",
      "the a!dghmmrf gont mying\n",
      "deashing and telt\n",
      "smilensly. \"No, poldned, a\n",
      "live with have man. I did not know\n",
      "thi, memar\n",
      "quive\n",
      "of interan the hamaving not.\n",
      "But yold this's uh nee, and I was delighted up her\n",
      "fa\n",
      "\n",
      "Epoch 1/1 | Batch 5810/78384 | train loss: 0.6707 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5820/78384 | train loss: 0.6813 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5830/78384 | train loss: 0.6719 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5840/78384 | train loss: 0.6687 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5850/78384 | train loss: 0.6852 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5860/78384 | train loss: 0.6871 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5870/78384 | train loss: 0.6794 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5880/78384 | train loss: 0.6745 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5890/78384 | train loss: 0.6818 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5900/78384 | train loss: 0.6834 | lr: 0.0010\n",
      "\n",
      "the aldd Kardnut officquont for whik. Oblonsky had intenterstelf, collred Obvor.\n",
      "\n",
      "\"I am a\n",
      "leag,\" she said. \"I you fnough un Petersburg,\" she endund reapid. And is in his arm off, answered hew has girls, o\n",
      "\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/1 | Batch 5910/78384 | train loss: 0.6767 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5920/78384 | train loss: 0.6731 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5930/78384 | train loss: 0.6802 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5940/78384 | train loss: 0.6862 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5950/78384 | train loss: 0.6767 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5960/78384 | train loss: 0.6755 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5970/78384 | train loss: 0.6782 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5980/78384 | train loss: 0.6712 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 5990/78384 | train loss: 0.6724 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6000/78384 | train loss: 0.6645 | lr: 0.0010\n",
      "\n",
      "the a!ntt'\" crunfergice, with the thom and conceos my my better have.\n",
      "\n",
      "\"Ah, Konus explandand with son, stand that I am net suppectong it. She know has she\n",
      "lovem, and it, I can, Anna with poyed because it \n",
      "\n",
      "Epoch 1/1 | Batch 6010/78384 | train loss: 0.6688 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6020/78384 | train loss: 0.6694 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6030/78384 | train loss: 0.6580 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6040/78384 | train loss: 0.6577 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6050/78384 | train loss: 0.6564 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6060/78384 | train loss: 0.6618 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6070/78384 | train loss: 0.6607 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6080/78384 | train loss: 0.6439 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6090/78384 | train loss: 0.6456 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6100/78384 | train loss: 0.6518 | lr: 0.0010\n",
      "\n",
      "the ;!IVmG'blh's ite Id plead ... I rayder tray mast becared before elenstand it. She call themer sayer, and young simple and without that in the doorw.\n",
      "\n",
      "\"What tan she elunadix being the other before ne e\n",
      "\n",
      "Epoch 1/1 | Batch 6110/78384 | train loss: 0.6584 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6120/78384 | train loss: 0.6462 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6130/78384 | train loss: 0.6506 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6140/78384 | train loss: 0.6450 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6150/78384 | train loss: 0.6543 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6160/78384 | train loss: 0.6416 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6170/78384 | train loss: 0.6363 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6180/78384 | train loss: 0.6388 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6190/78384 | train loss: 0.6437 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6200/78384 | train loss: 0.6394 | lr: 0.0010\n",
      "\n",
      "the a::'F rexpreas dailing. She knowns him naken for me, but they mething. You know how ... home verything. I know him, An alrya But,\" she said, gepching with with Dolly, while she\n",
      "lofe, and recollectly u\n",
      "\n",
      "Epoch 1/1 | Batch 6210/78384 | train loss: 0.6386 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6220/78384 | train loss: 0.6502 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6230/78384 | train loss: 0.6645 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6240/78384 | train loss: 0.6552 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6250/78384 | train loss: 0.6495 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6260/78384 | train loss: 0.6566 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6270/78384 | train loss: 0.6629 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6280/78384 | train loss: 0.6633 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6290/78384 | train loss: 0.6595 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6300/78384 | train loss: 0.6639 | lr: 0.0010\n",
      "\n",
      "the !;.''\n",
      "ble'g grod, I don't know; I chat's to to you, I my geagly, inulk of lone youn exceptsing of her which every humer, and reather's hure, the thought in all the that had knewn to as as me to she kn\n",
      "\n",
      "Epoch 1/1 | Batch 6310/78384 | train loss: 0.6702 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6320/78384 | train loss: 0.6648 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6330/78384 | train loss: 0.6722 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6340/78384 | train loss: 0.6748 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6350/78384 | train loss: 0.6781 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6360/78384 | train loss: 0.6653 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6370/78384 | train loss: 0.6520 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6380/78384 | train loss: 0.6655 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6390/78384 | train loss: 0.6738 | lr: 0.0010\n",
      "Epoch 1/1 | Batch 6400/78384 | train loss: 0.6758 | lr: 0.0010\n",
      "\n",
      "the ak... Woull, makaded us by a blal it forgovenging is dows id\n",
      "me been over the sow off, repleasing her.\n",
      "\n",
      "\"And how the possible to their was the visition of her hatchem. So\n",
      "here...\"\n",
      "\n",
      "\"It's reeverything \n",
      "\n",
      "Epoch 1/1 | Batch 6410/78384 | train loss: 0.6634 | lr: 0.0010\n"
     ]
    }
   ],
   "source": [
    "from rnn_text_gen import RNNTextGen\n",
    "\n",
    "\n",
    "if __name__ == '__main__':\n",
    "    with open('./temp/anna.txt') as f:\n",
    "        text = f.read()\n",
    "    \n",
    "    model = RNNTextGen(text, seq_len=200)\n",
    "    log = model.fit(start_word = 'the ', n_gen=200)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}
